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A note on outer bounds for broadcast channel 

Chandra Nair 



Abstract 

In this note we establish two facts concerning the so-called New-Jersey outer bound. We show that this outer 
bound is equivalent to a much simpler computable region; and secondly we show that in the absence of private 
information this bound is exactly same as the [/V^-outerbound. 



, \ I. Introduction 

O , Recently there has a flurry of activity on the outer bounds for the two-receiver broadcast channel. This 
work is an attempt to clean up the bounds and present a simple and clean picture. In this note we study the 
^ New-Jersey outer bound for 2-receiver discrete memoryless broadcast channel. We show that this bound 
is equivalent to another bound (Bound [3]). Further, the equivalent bound presented is also computable, i.e. 
the auxiliary random variables have bounded cardinalities, where as the original bound is not computable. 
Bound 1: [New-Jersey region: ^] The closure of the union of rate triples (Rq, Ri, R2) satisfying 

Ro<mm{I{T;Y\Wi),I{T;Z\W2)} 
C/3 ; Ri < I{U;Y\Wi) 

R2<I{V;Z\W2) 
Ro + Ri< I{T,U;Y\Wi) 
>'. Ro + Ri < I{U;Y\T,Wi,W2) + I{T,Wi; Z\W2) 

Ro + R2<I{T,V;Z\W2) 
^ ; Ro + R2 < I{V: Z\T,Wi,W2) + I{T,W2;Y\Wi) 

Ro + Ri+R2< I{U; Y\T, V, Wi,W2) + I{T, V, Wi;Z\W2) 
R.o + Ri+R2< I{V; Z\T, U, Wi,W2) + I{T, U, W2; Y\Wi) 
Ro + Ri+R.2< I{U;Y\T,V,Wi,W2) + I{T,W2;Y\Wi) + I{V; Z\T,Wi,W2) 
Ro + Ri+R2< I{V; Z\T, U, I^i, + I{T, Wi-Z\W2) + I{U; Y\T, Wi, W2) 

^ for some p{u)p{v)p{t)p{wi, W2\u, v, t)p{x\u, v, t, wi, W2)p{y, z\x) constitutes an outer bound. Further one 
^ can restrict X to be a deterministic function of (u, v, t, wi, 102) and U, V, T are uniformly distributed. 
■ - - Remark 1: The follow two points are worth noting: 

• In [HI, the authors note that Bound [T] is at least as good as the previously known bounds; however 
it is not clear if it is any better. It turns out that when Rq = 0, this note will prove that this is no 
better than a previously known bound. 

• The bound presented above differs slightly from the New- Jersey region[fTl. This is based on comments 
made to the author by Amin Gohari (based on his joint observation with Venkat Anantharam). Firstly, 
the region is the closure of the rate pairs (apriori, in the absence of cardinality bounds, it is not clear 
that the union is closed), and secondly the terms /(T, W2; Y\Wi), I{T, Wi] Z\W2) replace the terms 
I{T,Wi,W2]Y) and I(T,Wi,W2; Z) respectively in the last two inequalities. The same argument 
in the New Jersey bound shows that this expression is also a valid outer bound (and at least as good 
as the New Jersey bound). 

Now consider the following much simpler region. 



This result was presented as a part of the talk by the author in the International Zurich Seminar 2010. The purpose of this note is to serve 
as a documented proof of this fact. 
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Bound 2: The union of rate triples (i?o, Ri^ R2) that satisfy the following inequalities 

i?o < min{/(VF; Y)J{W; Z)} 

Ra + Ri< I{U; Y\W) + mm{I{W; Y), I{W; Z)} 

i?o + i?2 < I{V; Z\W) + min{/(VF; F), I{W] Z)] 
Ro + Ri+R2< mm{I{W; Y),I{W; Z)} + /([/; F W^) + I{V; Z\W) 
Ro + Ri+R2< mm{I{W; Y),I{W; Z)} + I{U; Y\W) + I{V; Z\U, W) 

over all p{u, v, w, x) such that ([/, V, W) X ^ (Y, Z) forms a Markov chain. 
Remark 2: We make the following simple observations: 

. Setting W = (T, VFi, 1^2), U' = U and V = V into Bound |2] we find that Bound [H C Bound |2l 

• Bound [2] can be directly obtained as an outer bound following standard manipulations. 

In the next section we will evaluate Bound \T\ and show the other non-trivial direction that Bound |2] C 
Bound [B 

II. The equivalence between Bound [Hand Bound [2] 

Clearly from the remark it suffices to show that Bound |2] C Bound \T\ The main idea is borrowed from 
a trick in [3J. We show that the constraints on the auxiliary random variables described by the following: 

• the union over distributions p{u)p{v)p{t)p{wi, W2\u, v, t)p{x\u, v, t, wi, W2)p{y, z\x) 

• Restrict X to be a deterministic function of (u, v, t, Wi, W2) and U, V, T are uniformly distributed 
are in effect red herrings, in the sense that even if we take the union over all p{u, v, t, wi, W2, x)p{y, z\x), 
we arrive at the same region. That is there is no real advantage in making our distributions more restrictive 
in the above sense; further, these restrictions prevent us from establishing cardinality bounds on the region. 

Denote the region obtained by Bound [T] by TZ and let TZi be the region obtained by the same constraints 
but with the union taken over p{u, v, t, wi, W2, x), such that X is a function of {U, V, T, Wi, W2). We will 
show these two regions are identical. 

Claim 1: TZ = TZi. 

Proof: Clearly, TZ CTZ^. Therefore it suffices to show the non-trivial direction. 
Given a {U,V,T,Wi,W2),\etU = {0, 1, mi - 1}, V = {0, 1, ma- 1}, and T = {0, 1, mg- 1}. 
Define new random variables U*,V*,T*, W^, W2 and a distribution p{u*,v*, t*,wl,W2, x) according to 

P{U* ^u,V* = v,T* = t,W* = {wi,i,k),W:^ = {w2j,k),X* = x) 

= PiU = iu + i),n„V = (V + j),n,,T = {t + k)^„Wl = Wi,W2 = W2,X ^ X) (1) 

771117121713 

where {■)mi denotes the mod operation, and k takes values in [0 : mi — 1], [0 : m2 — 1], [0 : m^ — l] re- 
spectively. Note that if X is a function of {U, V, T, Wi, W2), then X* is a function of {U*, V*,T*, W^, W^). 
It is straightforward to check the following: 

P{U* ^u,V* ^v,T* ^t) ^ (2) 

717177121713 

hence independent and uniformly distributed. 

p(r* = t, = {wi,i,k),x^ x) = ^^p(r = it + kU,,Wi ^wi,x^x) 0) 

771x7713 

P{T* = t, W; = {W2,j, k), X = x) = -^P{T ^it + kU,,W2 ^W2,X ^ x) (4) 

7712 TO3 

P{U* = u,W^ = {wi,i,k),X ^ x) = -^—P{U = {u + i)„r,,Wi = = x) (5) 

miTO3 

P{V* = v,W; = iw2,j,k),X ^x)^ -^P{V = {V+J)^,,W2 ^W2,X = X) (6) 

m2TO3 

P{U* ^u,T* ^t,W^ = {iui,i,k),X ^ x) = -^—P{U= {u + i)„r,,T = {t + kU,,Wi =wi,X :^x) (7) 
P(y* =v,T*= t, - {W2,j, k),X^x)^ -^PiV ^{v+ jU, ,T^{t + fc)„3 ,W2^W2,X^x). (8) 

7712 TO3 



3 



Similarly, one also obtains 



i P(T = (t + k)ra^,Wx =W^^W2=W2,X=X) (9) 

771177127713 



7/tl7/l2"'3 

P(C/* = ii,r* = t,Wl = (?7;i,7,fc),H/2* = (w2,i,fc),^ = a;) 

= ^ P(C/= (77 + 7)™,,T= (t + fc)™3,M^i = wi,M^2 = u.2,X =a:) 

771l77l277l3 



(10) 



P(l/= (7;+j)m.,r= (t + fc)„3,l¥l =7«i,l¥2 =1«2,^ = X) (11) 

771l77l2?7l3 

From the above it follows a straightforward manner that the following equalities hold: 

I{T*-Y*\Wl) = IiT-Y\Wi) (from ©) 
I(T*;Z*\W;) = I{T;Z\W2) (from ©) 
/([/*; y* I W^i*) = I{U;Y\Wi) (from ©) 
/(F*; Z*\W;) = I{V; Z\W2) (from ©) 
/(r*,C/*;y*|VFi*) = /(r,C/;y|H/i) (from O) 
/(T*,1/*;Z*|VF2*) = /(r,T/;Z|VF2) (from ©) 
/(T*, W^i*, M^2*; = ^(r, Wi, W2]Y) (from ®) 
/(T*, W^i*, M^2*; Z*) = I{T, Wi,W2; Z) (from ©) 
/(r*,H/2*;y*|W^*) = l{T,W2-,Y\Wi) (from dUl) 
/(T*, VKi*; Z*\W:^) = I{T, Wi; Z\W2) (from Q) 
/([/*; y*|r*,H/i*,VF2*) = /(?7;r|T,VFi,W^2) (from ^) 
I{V*;Z*\T*,W*,W;) = /(y;Z|r,l¥i,l¥2) (from (HB) 
/([/*; y*|r*,t/*,VKi*,PF2*) = /(?7;i^|T,F,VFi,VF2) (from CEJ) 
I{V*;Z*\T*,U*,W^,W;) = I{V;Z\T,U,Wi,W2) (from ©, (HOll) 



Hence all the terms that appears in bound are preserved, and hence TZi C TZ. Hence the region described 
by Bound \\\ is indeed the same as that described by the same expression, if we remove the structure on 

{u,v,T,Wi,W2).. m 

Given {U, V, W, X) such that X is a function of U, V, W, set U' = {U, W),V' = {V, W),T' = W, W[ = 
and 14^2 = 0- Plugging this choice into the constraints we see that the following region is a subset of 

7^l, 

Ro < min{/(W^; Y), I{W; Z)} 

Ri<I{U,W;Y) (12) 
R2<IiV,W;Z) (13) 

Ro + Ri< I{U, W] Y) 

Rq + Ri< I{U; Y\W) + I{W; Z) 

Ro + R2< I{V, W; Z) 

Ro + R2< I{V; Z\W) + I{W- Y) 
Ro + Ri + i?2 < I{U, W: Y) + I{V; Z\U, W) 
Ro + Ri+R2< I{V, W- Z) + I{U- Y\V, W) 
Ro + Ri+R2< I{W; Y) + I(U; Y\V, W) + I{V; Z\W) 
Ro + Ri+R2< I{W; Z) + I{U- Y\W) + I{V- Z\U, W) 
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Obviously the inequalities [I2l and \T3\ are redundant (due to non-negativity of rates. Thus the region 
described by Bound [2] (with the additional constraint that X is a function of U, V, W) is a subset of TZi. 

Remark 3: However it is easy to seeQ that the constraint X is a function of U, V, W still yields the 
entire region described by Bound [21 

Thus we have completed the proof of the other direction, i.e. we have shown that Bound ID ^ = 
that given by Bound [T]). This shows that the regions given by the two bounds, Bound [Hand Bound |2l are 
equal. 

III. UVW-OUTER BOUND 

From the previous section, it is clear that the following computable region is equivalent to the New- 
Jersey outer bound. 

Bound 3: [The UVW outer bound] The union of rate triples {Rq, Ri, R2) that satisfy the following 
inequalities 

Ro < min{J(H^; Y),I{W; Z)} 

Ro + Ri< I{U; Y\W) + mm{I{W- Y),I{W- Z)} 

Ro + R2< I{V- Z\W) + min{/(H^; Y)J{W- Z)] 

Ro + Ri + R2< min{J(H^; Y),I{W- Z)} + /(X; Y\V, W) + I{V; Z\W) 

Ro + Ri + R2< min{J(H^; Y),I{W; Z)} + I{U; Y\W) + I{X; Z\U, W) 

over all p{u,v,w)p{x\u,v,w) such that {U,V,W) — ^ X — t- (Y, Z) forms a Markov chain. Further it 
suffices to consider \W\ < \X\ + 5, \U\ < \X\ + 1, \W\ < \X\ + 1. 

Remark 4: The replacement of /([/; Y\V, W) with J(X; Y\V, W) and liV; Z\U, W) with /(X; Z\U, W) 
follows from the fact that we can assume that X is a function of U, V, W (w.l.o.g.). The proof of the 
cardinality bounds are established below. 

A. Computability of the outer bound 

Claim 2: To compute the region in Bound |3] it suffices to consider \ W\ < |X| + 5,|f/| < |X| + l,|iy| < 
|X| + 1. 

Proof: The proof of this claim follows from standard arguments: i.e. the Fenchel-Bunt extension to 
Caratheodory's theorem. We require W to preserve the distribution of X, and the values of H(Y\W), H(Z\W), 
H{Y\U,W),H{Z\U,W), H{Y\V,W),H{Z\V,W). Hence we can choose a W of cardinality at most 
|X| + 5, and distributions p{u,v, x\w) so as to preserve these quantities. (Observe that to preserve the 
distribution of X we only need |X| — 1 constraints.) Conditioned W = w, v^e can choose U of size |X| + 1 
so that p(X|Vr = w), H{Y\U, W = w), H{Z\U, W = w) is preserved. Similarly, we can choose a F of 
size |X| + 1 so that p(X|W^ = w), H{Y\V,W = w), H{Z\V,W = w) is preserved. Hence to compute 
the region, we can make the restrictions as stated in the claim. This makes the outer bound (Bound [3]) 
computable. ■ 

B. Private messages outer bound 

In this section we study the outer bound for the case Rq = (there is no common message). 
Claim 3: Whe Rq = 0, then Bound 3 is equivalent to an earlier bound (UV-outerbound which 
states that the union of rate triples R2) that satisfy the following inequalities 

Ri<I{U; Y) 

R2 < liV; Z) 
Ri + R2< IiX;Y\V) + I{V; Z) 
Ri + R2< I{U] Y) + I{X-Z\U) 

'standard argument: set U' = U,Q where Q is independent of (U, V, W) such that X is a function of U, V, W, Q always increases(may 
not be strict) the region. 
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over all p{u, v)p{x\u, v) such that (f/, V) ^ X ^ (Y, Z) forms a Markov chain form an outer bound to 
the capacity region. 

Proof: Given a {U,V,X) and the corresponding region in the UV-outer bound, by setting = 0, f/ = 
[/, y = F we see that this region is contained in the region described by Bound [3l Hence UV-outer bound 
C Bound [31 

Given a ([/, V, W, X) and the corresponding region in Bound [3l by setting U = (U, W); V = {V, W) 
we see that this region (in Bound [3]) is contained in the region described by the UV-outer bound. Hence 
UV-outer bound D Bound |3l 

Hence the two regions are equivalent. ■ 

IV. Conclusion 

In this work we summarize the state of the various recent attempts at writing an outer bound for the 
two-receiver broadcast channel. It is not clear whether the UVW outer bound in Bound |3] is any better 
than the one presented in [2 J (it is at least as good). The main contribution here is to collect all the 
developments on the outer bound, and present a simple bound that is as good as all the outer bounds 
currently developed. More importantly, we also make the outer bound region computable. 

Hopefully this note can be useful to the researchers and to the community in general while trying to 
figure out the relationship between the bounds. 
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